Holistic In-Network Acceleration for Heavy-Tailed Storage Workloads
نویسندگان
چکیده
Storage workloads are typically heavy-tailed, and a small number of large requests incur burdensome performance overhead. To this end, we present NetStore, an in-network storage accelerator that exploits the capability emerging programmable switches. The key idea NetStore is to directly process in network by leveraging switches as request processor. not only mitigates head-of-line blocking but also provides extra computational power for data storage. overcome strict resource constraints switch ASIC, take holistic approach carefully co-designs plane control plane. Specifically, design custom acts dedicated processor performs size-aware scheduling object tracking. Our solution can be implemented on commodity at line rate using 6.82% memory.We implement prototype Intel Tofino conduct series testbed experiments. experimental results demonstrate improve throughput, median latency, 99th percentile latency up 1.19×, 21.29×, 2.91×, respectively.
منابع مشابه
Systems with multiple servers under heavy-tailed workloads
The heavy-tailed nature of Internet flow sizes, web pages and computer files can cause non-preemptive scheduling policies to have a large average response time. Since there are numerous communication and distributed processing systems where preempting jobs can be quite expensive, reducing response times under this constraint is a pressing issue. One proposal for tackling non-preemption is throu...
متن کاملNetwork structure inhibits information cascades in heavy-tailed social networks
Information and ideas spread over social networks, with online social media platforms being a powerful medium to accelerate information ow. Characterising and understanding the role of network structure on this information ow is important in numerous elds, yet is limited by the availability of network data exhibiting a range of structural properties. It is therefore essential to use mathemat...
متن کاملMetadata Workloads for Testing Big Storage Systems
Efficient namespace metadata management is becoming more important as next-generation file systems are designed for the peta and exascale era. A number of newmetadata management schemes have been proposed. However, evaluation of these designs has been insufficient, mainly due to a lack of appropriate namespace metadata traces. Specifically, no Big Data storage system metadata trace is publicly ...
متن کاملNetwork Multiplexer with Truncated Heavy-Tailed Arrival Streams
This pa.per investigates the asymptotic behavior of a single server queue with truncated heavy-tailed arrival sequences. 14'-e have discovered and explicitly asymptotically cha.ra.cterized a unique asymptotic behavior of t,he queue length distribution. Informally, this distribution on t,he log scale resembles a stair-wave function t h t lias steep drops a t specific buffer sizes. This has impor...
متن کاملHeavy - Tailed Distributions in CombinatorialSearchCarla
Combinatorial search methods often exhibit a large variability in performance. We study the cost prooles of combinatorial search procedures. Our study reveals some intriguing properties of such cost prooles. The distributions are often characterized by very long tails or \heavy tails". We will show that these distributions are best characterized by a general class of distributions that have no ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2023
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2023.3298552